The Importance of Crew Resource Management Behaviors in Mission Performance: Implications for Training Evaluation

Cockpit/crew resource management (CRM) training within the military has grown rapidly despite the paucity of empirical data linking CRM to mission performance. CRM training objectives (and course content) are often too vague to allow meaningful training evaluation within the context of traditional transfer-of-training paradigms. A multimeasure methodology that exploits all sources ofarchival and observational data within a training organization has the potential to advance training evaluation, particularly for crew-based skills such as CRM. This article discusses a variety ofCRM data sources and presents findings using 2 ofthese sources: instructor comments in student training folders and over-the-shoulder observations ofcrews in tactical simulators. Instructor comments revealed that CRM problems early in training most frequently involve decision making and communication among crew members. Over-the-shoulder observations ofexperienced crews showed high correlations between independent ratings ofCRM proficiency and mission performance. The most effectivecrews exhibited such characteristic CRM behaviors as the presence ofa single leaderand willingness to change plans based on changing mission situations. The article closes by describing how these study data can be used to restructure CRM training into a set of behavior-based objectives that will enable meaningful evaluation of its effectiveness in improving the performance levels of all student crews.